Perfect Sampling of Harris Recurrent Markov Chains

نویسنده

  • J. N. Corcoran
چکیده

We develop an algorithm for simulating \perfect" random samples from the invariant measure of a Harris recurrent Markov chain. The method uses backward coupling of embedded regeneration times, and works most eeectively for nite chains and for stochas-tically monotone chains even on continuous spaces, where paths may be sandwiched below \upper" and \lower" processes. Examples show that more naive approaches to constructing such bounding processes may be considerably biased, but that the algorithm can be simpliied in certain cases to make it easier to run. We give explicit analytic bounds on the backward coupling times in the stochastically monotone case. An application of the simpler algorithm to storage models is given.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Generalized Resolvents and Harris Recurrence of Markov Processes

In this paper we consider a φ-irreducible continuous parameter Markov process Φ whose state space is a general topological space. The recurrence and Harris recurrence structure of Φ is developed in terms of generalized forms of resolvent chains, where we allow statemodulated resolvents and embedded chains with arbitrary sampling distributions. We show that the recurrence behavior of such genera...

متن کامل

Further Criteria for Positive Harris Recurrence of Markov Chains

We provide several necessary and sufficient conditions for a Markov chain on a general state space to be positive Harris recurrent. The conditions only concern asymptotic properties of the expected occupation measures.

متن کامل

Regeneration-based statistics for Harris recurrent Markov chains

Harris Markov chains make their appearance in many areas of statistical modeling, in particular in time series analysis. Recent years have seen a rapid growth of statistical techniques adapted to data exhibiting this particular pattern of dependence. In this paper an attempt is made to present how renewal properties of Harris recurrent Markov chains or of specific extensions of the latter may b...

متن کامل

Harris Recurrence of Metropolis-Within-Gibbs and Trans-Dimensional Markov Chains

A φ-irreducible and aperiodic Markov chain with stationary probability distribution will converge to its stationary distribution from almost all starting points. The property of Harris recurrence allows us to replace “almost all” by “all,” which is potentially important when running Markov chain Monte Carlo algorithms. Full-dimensional Metropolis–Hastings algorithms are known to be Harris recur...

متن کامل

Wide-sense regeneration for Harris recurrent Markov processes: an open problem

Harris recurrence is a widely used tool in the analysis of queueing systems. For discrete-time Harris chains, such systems automatically exhibit wide-sense regenerative structure, so that renewal theory can be applied to questions related to convergence of the transition probabilities to the equilibrium distribution. By contrast, in continuous time, the question of whether all Harris recurrent ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1998